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(57) Abstract: Light from an object (152) moving through an 
imaging system (154) is collected, dispersed, and imaged onto a 
148 time delay integration (TDI) detector (148) that is inclined rel- 

ative to an axis of motion of the object, producing a pixilated 
output signal. In one embodiment, the movement of the im- 
age object over the TDI detector (148) is asynchronous with the 
movement of the output signal producing an output signal that 
is a composite of the image of the object at varying focal point 
along the focal plane. In another embodiment, light from the ob- 
ject is periodically incident on the inclined TDI, producing a plu- 
rality of spaced apart images and corresponding output signals 
that propagate across the TDI detector (148). The inclined plane 
enables images of FISH probes or other components within an 
object to be produced at different focal point, so that the 3D spa- 
tial relationship between the FISH probes or components can be 
resolved. 
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ALTERNATIVE DETECTOR CONFIGURATION AND 
MODE OF OPERATION OF A TIME DELAY 
INTEGRATION PARTICLE ANALYZER 
Related Applications 

5 This application is based on a prior co-pending provisional application 

Serial No. 60/228,078, filed on August 25, 2000, the benefit of the filing date of 
which is hereby claimed under 35 U.S.C. § 1 19(e). 

Field of the Invention 
This invention generally relates to imaging objects or particles for 
10 purposes of detection and analysis, and more specifically, to a system and method 
for analyzing the three dimensional structure, contents, and spectral composition 
of objects, such as cells, which may be in motion. 

Background of the Invention 
There are a number of biological and medical procedures that are currently 
15 impractical due to limitations in cell and particle analysis technology. Examples 
of such procedures include battlefield detection and monitoring of both known 
and unknown toxins, non-invasive prenatal genetic testing and routine cancer 
screening via the detection and analysis of rare cells (i.e., cells having a low rate 
of occurrence) in peripheral blood, and drug discovery via high throughput cell 
20 assays. 

New medical and biological procedures increasingly require more 
advanced cell analysis capabilities than currently exist. One example is the 
analysis of changes in the genetic constitution of tumor cells for the optimization 
of chemotherapy. Tumor cells may exhibit unusual DNA changes, such as a 

25 variation in the number of chromosomes, the amplification of chemotherapy- 
resistance genes, or changes in the regulation of gene expression. These changes 
can be detected using Fluorescence In-Situ Hybridization (FISH) probes that bind 
to specific DNA sequences within cells. FISH analysis requires an accurate 
determination of the number of distinct FISH locations within the nucleus of a 

30 cell, ideally in three dimensions. Commonly assigned U.S. Patent Application 
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Serial No. 09/490,478 describes the use of a stereoscopic imaging apparatus to 
view fluid-suspended cells from multiple angles, with a high numerical aperture 
for the accurate enumeration of FISH spots within a cell. This technique can be 
applied to a slide-mounted sample or a sample on a micro-fluidic chip, but 
5 generally with lower numerical apertures, due to the difficulty of coupling 
orthogonal collection systems to the flat sample substrate. Clearly, it would be 
preferable to perform three-dimensional (3D) imaging of cells on slides or in 
micro-capillaries with a single collection system in order to enable light collection 
with a high numerical aperture. 

10 The most accurate determinations of FISH spot counts in cells on flat 

substrates are currently based on high-resolution fluorescence images taken at 
different focal planes across the depth of the cell. The resulting set of two- 
dimensional (2D) images are reconstructed into a three-dimensional (3D) 
representation of the cell, and FISH spots are counted both within and across the 

15 image planes to ensure that superimposed FISH spots within a single image are 
resolved across the multiple images. While such image stacking techniques can 
effectively resolve superimposed FISH spots, existing systems for 3D cell 
imaging are slow, often requiring several minutes to create each 3D composite. 
As a result, the various 2D images are gathered at widely different times, and 

20 changes in the cell over the course of the imaging process alter the resulting 3D 
representation. Further, such systems cannot tolerate movement of the cells 
during the imaging process, which limits their application to fixed cells that are 
immobilized on slides. An improved system would allow the rapid 3D imaging of 
cells, including cells in motion. 

25 Accordingly, it will be apparent that an improved technique is desired that 

resolves the limitations in analyzing the three-dimensional features of both 
stationary and moving cells imposed by the conventional approaches discussed 
above. In addition, a new approach developed to address these problems in the 
prior art should also have application to the analysis of other types of objects 

30 besides cells and should be amenable to implementation in different 
configurations to meet the specific requirements of disparate applications of this 
technology. 

Summary of the Invention 

The present invention is directed to an imaging method and system that is 
35 adapted to determine one or more characteristics of an object from an image of the 
object. There can be relative movement between the object and the imaging 
system, and although it is contemplated that either (or both) may be in motion, the 
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object will preferably move while the imaging system is fixed in position. In 
addition, it should also be understood that while much of the following disclosure 
recites "an. object," it is likely that the present invention will preferably be used 
with a plurality of objects and is particularly useful in connection with imaging a 
5 stream of objects or objects moving within a substrate, e.g., in narrow capillaries. 
Also, it should be understood that as used herein and in the following claims, the 
terms "image" and "imaging" are broadly applied and are intended to generally 
refer to the light from an object or objects that is directed onto a surface of a 
detector; thus, these terms are intended to encompass light from an object or 

10 objects that is diffused, dispersed, or blurred on the surface of a detector, as well 
as light from an object or objects that is focussed onto the surface of the detector, 
and light from an object or objects that is divided into one or more spectral 
components incident on the surface of the detector. 

The present invention may be applied to the rapid analysis of cells in three 

15 dimensions for purposes such as biological warfare agent detection, prenatal 
diagnosis, cancer screening, drug discovery, and other applications. To achieve 
such functional capabilities, the present invention collects image data from 
multiple focal positions within moving or stationary cells. Further, these data may 
be acquired over a large spectral range with high spectral and spatial resolution. 

20 The present invention preserves the spatial origin of the spectral information 
gathered from the object, enabling the discrimination of small sources of the same 
or different colored light emanating from the object. To accomplish these tasks, 
the present invention employs novel combinations of Time-Delay-Integration 
(TDI) imaging, synchronous and non-synchronous signal generation, and uses an 

25 optical system with an inclined detector orientation, and in some cases, a spectral 
dispersing element. 

The TDI detector that is used in the various embodiments of the present 
invention preferably comprises a rectangular charge-coupled device (CCD) that 
employs various specialized pixel read out algorithms. Standard, non-TDI CCD 

30 arrays are commonly used for 2D imaging in cameras. In a standard CCD array, 
photons that are incident on a light sensitive element (corresponding to one pixel 
of an image and therefore referred to herein as a "pixel") produce charges that are 
trapped in the element. After image acquisition, the photon charges from each 
light sensitive pixel are read into an output capacitor, producing a voltage 

35 proportional to the charge. Between pixel readings, the capacitor is discharged 
and the process is repeated for every pixel on the chip. During the readout, the 
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array must be shielded from any light exposure to prevent charge generation in the 
pixels that have not yet been read. 

In a TDI detector comprising a CCD array of physical pixels, the CCD 
array remains exposed to the light as the pixels are read out. The projection of an 
5 image on the array of physical pixels generates a pixilated signal. The readout 
typically occurs one row at a time, e.g., from the top to the bottom of the array. 
Once a first row is read out, the signal pixels in the remaining rows are shifted by 
one physical pixel in the direction of the row that has just been read. If the object 
being imaged onto the array moves in synchrony with the motion of the signal 

10 pixels, light from the object is integrated without image blurring for the duration 
of the TDI detector's total readout period. The signal strength produced by a TDI 
detector increases linearly with the integration period, which is proportional to the 
number of physical TDI pixel rows, but the noise increases only as the square root 
of the integration period, resulting in an overall increase in the signal-to-noise 

15 ratio (SNR) compared to a conventional CCD array, by a factor equal to the 
square root of the number of rows. 

In the present invention, there are four entities that may be in motion. These 
include the object being imaged, the image of the object projected on the detector, 
the detector itself, and the pixilated signal generated by the image on the detector. 

20 Any relative movement between the object and the detector results in movement of 
the image across the detector. TDI imaging, unlike other imaging methods, 
involves the movement of the pixilated signal across the detector while the 
measurement is being performed. In many cases, it is contemplated that the image 
of the object will move across the detector. However, the pixilated signal may not 

25 move in synchrony with the image of the object. In the present invention, the 
velocity of signal motion is a controllable parameter that can be adjusted in order to 
measure various features of the object being imaged. The signal can be made to 
move faster, slower, or in a different direction than the image, which may or may 
not itself be moving. Further, the movement of the signal can be changed 

30 dynamically during the measurement. The nature of the asynchrony in part 
determines the features of an object or objects that can be measured. 

In TDI imaging of objects that was disclosed in previous pending 
applications, the image of the object moves synchronously with the pixilated signal 
(in the same direction and with the same speed), light forming each portion of the 

35 image is collected in the. same portion of the pixilated signal over time, regardless 
of the motion. Conversely, if the image of the object moves asynchronously 
relative to the pixilated signal, (at a different speed and/or in a different direction), 
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light forming each portion of the image at later times will not be collected in the 
same portion of the pixilated signal. By intentionally desynchronizing the motion 
of the pixilated signal on the TDI detector from the motion of the image, temporally 
distinct pixilated signals are produced. In the present invention, this effect, coupled 
5 with an inclination of the detector relative to the plane formed by the motion of the 
objects, can produce distinct images from different focal positions within the object. 
In the present invention, when the pixilated signal moves synchronously with the 
image, a characteristic signal intensity profile is produced that can be used to 
identify point sources of light such as those created by FISH probes. 

10 Another adjustable parameter in the present invention is the continuity of 

signal generation. In some embodiments of the invention, the signal from the object 
is detected continuously. An exemplary application of continuous detection would 
be the imaging of a cell containing a chemiluminescent substrate that constantly 
emits light. Another example would be a cell illuminated by a continuous-wave 

15 laser or arc lamp to form a scatter, absorption, or fluorescence image on the 
detector. In other embodiments of the invention, the signal from the object is 
detected in a discontinuous fashion. For example, discontinuous detection would 
occur if a cell is illuminated by a pulsed or modulated laser to form transient scatter, 
absorption, or fluorescence images on the detector. Another example of 

20 discontinuous detection would be if a chemiluminescent cell is imaged via a 
shuttered or gated TDI detector. Signal continuity, when controlled in combination 
with the orientation of the detector plane and the synchrony of signal readout, gives 
rise to numerous embodiments and modes of operation of the present invention. 
Brief Description of the Drawing Figures 

25 The foregoing aspects and many of the attendant advantages of this 

invention will become more readily appreciated as the same becomes better 
understood by reference to the following detailed description, when taken in 
conjunction with the accompanying drawings, wherein: 

FIGURES 1A, IB, and 1C respectively show a plan view, an elevational 

30 view, and an isometric view of an exemplary imaging system suitable for 
implementing the present invention, in which particles conveyed by a fluid stream 
are imaged on a TDI detector; 

FIGURE 2 illustrates the focal positioning effects of tilting the TDI 
detector plane in an optical system relative to the plane defined by the motion of . 

35 the objects traversing the field of view; 

FIGURES 3A and 3B are views over time illustrating the operation of a 
first embodiment in which an object is detected continuously, and signals 
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produced from images of the object are clocked synchronously to produce a 
composite image containing information from . a plurality of different focal planes 
across a depth of the object; 

FIGURE 3C illustrates the characteristic intensity profile of a luminescent 
5 point source imaged by the first embodiment; 

FIGURES 4A-4F are a plurality of images of an object over time, 
illustrating discontinuous imaging wherein the pixilated detector signals are 
clocked more rapidly than image movement over the TDI detector; 

FIGURES 5A-5F are a plurality of images of an object over time, 
10 illustrating discontinuous imaging wherein the pixilated detector signals are 
clocked more slowly than image movement over the TDI detector; 

FIGURE 6A is a view over time illustrating the position of two 
luminescent point sources located at different depths within a cell with respect to 
the TDI detector plane; and 
15 FIGURE 6B illustrates characteristic images of two luminescent point 

sources located at different depths within a cell being imaged by a second 
embodiment. 

Description of the Preferred Embodiment 

The present invention offers considerable advantages over systems 

20 employed for cell and particle analysis in the prior art. These advantages arise 
from the use in the present invention of an optical dispersion system in 
combination with a TDI detector to produce an output signal in response to the 
images of cells and other objects that are directed on the TDI detector. Multiple 
objects can be imaged on the TDI detector at the same time. In addition, the 

25 image of each object can be spectrally decomposed to discriminate object features 
by absorption, scatter, reflection, or probe emissions using a readily available TDI 
detector for the analysis. 

The present invention can be employed to determine morphological, 
photometric and spectral characteristics of cells and other objects by measuring 

30 optical signals including light scatter, reflection, absorption, fluorescence, 
phosphorescence, luminescence, etc. Morphological parameters include nuclear 
area, perimeter, texture or spatial frequency content, centroid position, shape (i.e., 
round, elliptical, barbell-shaped, etc.), volume, and ratios of any of these 
parameters. Similar parameters can also be determined for the cytoplasm of cells 

35 with the present invention. Photometric measurements with the invention enable 
the determination of nuclear optical density, cytoplasm optical density, 
background optical density, and the ratios of any of these values. An object being 
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imaged with the present invention can be stimulated into either fluorescence or 
phosphorescence to emit light, or may be luminescent, producing light without 
stimulation. In each case, the light from the object is imaged on the TDI detector 
of the present invention, and the output signal of the TDI detector analyzed to 
5 determine the presence and amplitude of the emitted light, the number of discrete 
positions in a cell or other object from which the light signal(s) originate(s), the 
relative position of the signal sources, and the color (wavelength or waveband) of 
the light emitted at each position in the object. 

An initial application of the imaging system comprising the present 

10 invention will likely be as a cell analyzer to determine one or more of the 
parameters listed above, for cells entrained in a fluid flowing through the imaging 
system. However, it should also be understood that this invention can be used for 
imaging other kinds of moving objects. 

The present invention concerns alternative detector configurations and 

15 modes of operation in connection with various imaging system embodiments 
disclosed in commonly assigned copending patent applications, including Serial 
Nos. 09/490,478 and 09/538,604, the specification and drawings of which are 
hereby specifically incorporated herein by reference. For convenience, portions 
of the first of the above-noted applications are reproduced below in order to 

20 facilitate access to portions of its disclosure that will enable a reader to better 
understand how various embodiments of the present invention are implemented. 
However, it will be understood that the present invention can be implemented 
with other imaging system configurations disclosed in the above-referenced 
applications, which are not specifically discussed herein, as well as other imaging 

25 systems of related configuration. 

A first exemplary configuration of an imaging system 20 that is suitable for 
implementation of the preferred embodiments of the present invention described 
below is schematically illustrated in FIGURES 1A-1C, in connection with 
producing images of moving objects such as cells that are conveyed by a fluid 

30 flow 22 through the imaging system. In FIGURE 1 A, fluid flow 22 entrains an 
object 24 (such as a cell, but alternatively, a small particle of a different sort) and 
carries the object through the imaging system. The direction of the fluid flow in 
FIGURE 1 A is into (or out of) the sheet, while in FIGURES 1B-1C, the direction of 
fluid flow is from top to bottom, as indicated by the arrow to the left of the Figures. 

35 Light 30 from object 24 passes through collection lenses 32a and 32b that collect 
the light, producing collected light 34, which is approximately focussed at infinity, 
i.e., the rays of collected light are generally parallel. Collected light 34 enters a 
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dispersing element 36, which disperses the light, producing dispersed light 38. The 
dispersed light then enters imaging lenses 40a and 40b, which focusses light 42 
onto a TPI detector 44. It should be noted that as used throughout this document, a 
TDI detector can generally be oriented in different "positions, so that the terms 
5 "row" and "column," "up" and "down," and "left" and "right" as applied to a TDI 
detector are only meaningful in regard to each exemplary illustration, but are not 
intended to be limiting in regard to the scope of the claims. 

As shown in the Figures, imaging system 20 may optionally include a 
shutter 41 or a gated image intensifier 43. In these instances, Shutter 41 or gated 

10 image intensifier 43 are used to interrupt the light directed onto the TDI detector 
and thus interrupt the formation of images produced by the system of the detector, 
so as to produce a discontinuous image that falls upon TDI detector 44. In 
general, shutter 41 can be placed anywhere along the light path, including 
between object 24 and the collection lenses 32a and 32b, or between imaging 

15 lenses 40a and 40b and TDI detector 44. An exemplary alternative disposition is 
indicated in the Figure by a shutter 41 \ Preferably, gated image intensifier 43 will 
be disposed between the imaging lenses and the TDI detector, although this 
exemplary disposition is not limiting, as will be understood by those skilled in the 
optical arts. Further details of the use of shutter 41 and gated image intensifier 43 

20 in the present invention are discussed below. 

With reference to FIGURE IB, if it is assumed that the Figure depicts the 
imaging of object 24 over time, the object is shown at both a position 26 and a 
position 28 as it moves with fluid flow 22. As a consequence, images of object 24 
will be produced on the detector at two discrete spatial positions 26' and 28', as 

25 indicated on the right side of FIGURE IB. Alternatively, if it is assumed that 
FIGURE IB is depicting a single instant in time, positions 26 and 28 represent the 
location of two separate objects, which are simultaneously imaged on the detector 
at positions 26' and 28'. 

In regard to imaging system 20 and all other imaging systems illustrated 

30 herein, it will be understood that the lenses and other optical elements illustrated 
are shown only in a relatively simple form. Thus, the collection lens is illustrated 
as a compound lens comprising only collection lenses 32a and 32b. Lens 
elements of different designs, either simpler or more complex, can alternatively be 
used in constructing the imaging system to provide the desired optical 

35 performance, as will be understood by those of ordinary skill in the art. The 
simplicity or complexity of the actual lenses or optical elements used in the 
imaging system will depend upon the particular type of imaging application for 
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which the imaging system will be employed. It is further noted that imaging 
systems not including a light-dispersing element such as prism 36, may also be 
implemented to provide the present invention. 

It will be understood that relative movement exists between the object being 
5 imaged and the imaging system. In most cases, it will be more convenient to move 
the object than to move the imaging system. However, it is also contemplated that 
in some cases, the object may remain stationary and the imaging system move 
relative to it. As a further alternative, both the imaging system and the object may 
be in motion, but either in different directions or at different rates. 

10 The TDI detector that is used in the various embodiments of the present 

invention preferably comprises a rectangular charge-coupled device (CCD) that 
employs a specialized pixel read out algorithm, as explained below. Non-TDI CCD 
arrays are commonly used for 2D imaging in cameras. In a standard CCD array, 
photons that are incident on a pixel produce charges that are trapped in the pixel. 

15 The photon charges from each pixel are read out of the detector array by shifting the 
charges from one pixel to the next, and then transferring the charges to an output 
capacitor, producing a voltage proportional to the charge. Between pixel readings, 
the capacitor is discharged and the process is repeated for successive pixels on the 
chip. During the readout, the array must be shielded from any light exposure to 

20 prevent charge generation in the pixels that have not yet been read. 

In one type of TDI detector 44, which comprises a CCD array, the CCD 
array remains exposed to the light as the pixels are read out. The readout occurs 
one row at a time from the top toward the bottom of the array. Once a first row is 
read out, the remaining rows are shifted by one pixel in the direction of (i.e., 

25 toward) the row that has just been read. If the object being imaged onto the array 
moves in synchrony with the motion of the pixels, light from the object is 
integrated for the duration of the TDI detector's total readout period without image 
blurring. The signal strength produced by a TDI detector increases linearly with 
the integration period, which is proportional to the number of TDI rows, but the 

30 noise increases only as the square root of the integration period, resulting in an 
overall increase in the SNR by a factor equal to the square root of the number of 
rows. One TDI detector suitable for use in the present invention is a Dalsa Corp., 
Type IL-E2 image sensor, although other equivalent or better image sensors can 
alternatively be used. The Dalsa image sensor has 96 stages or rows, each 

35 comprising 512 pixels; other types of image sensors useable in the present 
invention may have a different configuration of rows and columns or a non- 
rectilinear arrangement of pixels. The Dalsa sensor has approximately 96 times 
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the sensitivity and nearly 10 times the SNR of a conventional CCD array. The 
extended integration time associated with TDI detection also serves to average out 
temporal and spatial illumination variations, increasing measurement consistency. 
In imaging system 20 and in other exemplary imaging systems described 
5 herein that employ a fluid flow to carry objects through the imaging system, a 
flow-through cuvette or a microcapillary (not shown) contains the cells or other 
objects being analyzed. The velocity and cellular concentration of the fluid may 
be controlled using syringe pumps, gas pressure, or other pumping methods (not 
shown) to drive a sample solution through the system to match the pixel readout 

10 rate of the TDI detector. However, it should be understood that the readout rate of 
the TDI detector can be selectively controlled, as required, to match the motion of 
the sample solution. 

Various optical magnifications can be used to achieve a desired resolution 
of the object that is being imaged on the light sensitive regions (pixels) of the TDI 

15 detector. It is contemplated that in most embodiments, the optical magnification 
will fall within a range of 1:1 to 50:1, providing a substantial range in the number 
of light sensitive regions on the TDI detector on which images of the object are 
formed. The number of regions will also depend on the actual size of the object 
being imaged and its distance from the imaging system. It is envisioned that the 

20 present invention has applications to technology ranging from the analysis of cells 
and other microscopic objects to the imaging of stellar objects. 

It should be emphasized that the present invention is not limited to CCD 
types of TDI detectors. Other types of TDI detectors, such as complementary 
metal oxide semiconductor (CMOS) and multi-channel plate imaging devices 

25 might alternatively be used for the TDI detector in the present invention. It is 
important to understand that any pixilated device (i.e., a device having a multitude 
of light sensitive regions) in which a signal produced in response to radiation 
directed at the device can be caused to move through the device in a controlled 
fashion is suitable for use as the TDI detector in the present invention. Typically, 

30 the signal will move in synchrony with a moving image projected onto the device, 
thereby increasing the integration time for the image, without causing blurring. 
However, the motion of the signal can be selectively desynchronized from the 
motion of the radiation image, as required to achieve a desired effect. 
First Preferred Embodiment 

35 In accord with a first preferred embodiment, TDI clocking is synchronous 

with the motion of the image of the object, the signal is detected continuously, and 
the TDI detector is oriented in a plane inclined relative to the axis of motion of the 
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object. Such a configuration is shown in FIGURE 2 and it includes a TDI 
detector 148 that is tilted at an incline angle (j> relative to an object motion 
axis 150. An object 152 is traveling along object motion axis 150 and is imaged 
on TDI detector 148 by an imaging lens 154. The inclination of the detector plane 
5 produces an inclined plane of focus 156, as illustrated in the Figure. In this 
configuration, measurements taken at different times will have different planes of 
focus within the object. However, because the first preferred embodiment 
employs synchronous clocking and continuous detection, only a single image is 
formed. Synchronous clocking with an inclined detector requires a different 
10 clocking frequency than when the detector is parallel to the axis of motion. For a 
given angle (J) between the detector plane and the axis of motion, the projected 
velocity of the detector signal V s in the axis of object motion is 

V s '=V s *Cos(<)>). (1) 

The inclined detector therefore requires a slightly higher TDI clock rate to 

15 maintain synchronous operation. 

In this first preferred embodiment of the present invention, the TDI 
detector operates in synchronous mode, with continuous signal detection. In this 
embodiment, the TDI detector output signal is continuously monitored during the 
entire traversal period of the image across the TDI detector. The inclination of the 

20 TDI detector causes the plane of focus of the imaging optics to sweep the image 
of the object across the TDI detector, continuously superimposing image signals 
on the TDI detector. However, because the TDI detector is operated in 
synchronous mode, there is no lateral shift between the superimposed image 
signals. The net effect is equivalent to "racking focus" through an object while 

25 collecting image signals. 

This focus racking effect can be used to enhance the detection of luminous 
point sources such as FISH probes within a cell. FISH signals can originate 
anywhere within a cell nucleus, which is typically 10 microns in diameter. 
Because the depth of focus of a typical cell imaging system is less than 

30 one micron, FISH signals can be located well outside of the plane of focus of a 
single image. The first preferred embodiment enables the simplified detection of 
such signals via the analysis of a single composite image from a system 
employing continuous detection. 

Luminous point sources that lie outside of the plane of focus produce wide 

35 illumination regions with intensity profiles that are not steeply inclined, making 
them difficult to detect and enumerate. By racking focus through the cell, every 
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FISH signal within that cell will pass through the plane of focus and take on a 
peaked intensity profile in the resulting image, regardless of the original position 
of the FISH probes in the cell. This point is illustrated by FIGURES 3A, 3B, 
and 3C. FIGURE 3A shows the position of a FISH spot 170 (produced by 
5 imaging a FISH probe within a cell 58) relative to an inclined focal plane 172 
over time, drawn from a perspective orthogonal to the optic axis of the imaging 
system. FIGURE 3B is a view of TDI detector 148 from a perspective along the 
optic axis of the imaging system. When inclined focal plane 170 enters cell 58, 
TDI detector 148 detects a blurred image 174 of FISH spot 170. As FISH 

10 spot 170 moves closer to inclined focal plane 172, the FISH spot's corresponding 
image 174 on TDI detector 148 becomes less blurred. Because the image is 
continuously detected in synchronization with the moving cell, image 174 will 
reflect a gradient change in size and intensity of FISH spot 170 within image 174. 
However, for clarity, each image 174 is shown at discrete times, ti through ts, with 

15 discrete sizes and discrete intensity levels. The image size reaches a minimum 
when FISH spot 170 passes through inclined focal plane 172 (i.e., at time t 3 ). 
Thereafter, FISH spot 170 recedes from the focal plane, spreading its image over 
an increasingly larger area of TDI detector 148. 

FIGURE 3C illustrates the characteristic inverse square intensity profile of 

20 a composite image produced by this preferred embodiment. Since the signal 
produced by image 174 is spread over a smaller area as FISH spot 170 approaches 
inclined focal plane 172, the intensity profile of the signal becomes steeper and 
achieves a maximum slope upon intersection with the focal plane. The high, 
sharp peak of the profile is more easily recognized by threshold algorithms, while 

25 the characteristic inverse squared slope of the profile can be used as a signature to 
distinguish FISH probe signals from image artifacts or noise. 
Second Preferred Embodiment 

Like the first preferred embodiment, the second preferred embodiment 
employs a TDI detector inclined at an angle <j> relative to the apparent axis of 

30 motion of the object. However, unlike the first embodiment, in the second 
preferred embodiment, signal detection is discontinuous. Discontinuous detection 
can occur as a result of employing a pulsed laser or other type of pulsed or strobed 
light source to illuminate the object. If the object being imaged is 
chemiluminescent or if the light from the object is continuous for some other 

35 reason, such as the object being illuminated by a continuous light source, a shutter 
or gated image intensifier can be employed between the object and the detector to 
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produce discontinuous detection, such as described above with reference to 
shutter 41 and gated image intensifier 43 in Figures 1 A-1C. 

Also, unlike in the first preferred embodiment, a signal readout from the 
TDI detector in the second preferred embodiment is asynchronous, such that the 
5 velocity of the pixilated signal differs from the velocity of the image for at least 
part of the time that the image of the object is projected on the TDI detector. The 
difference between the signal and image velocities causes a divergence over time 
between the position of the image and the detector signal. There are three modes 
of asynchronous operation of the second embodiment. In the first mode of 

10 operation, the pixilated signal is clocked across the TDI detector more rapidly 
than the movement of the image. In the second mode of operation, the pixilated 
signal is clocked across the TDI detector more slowly than the movement of the 
image. And, in the third mode of operation, the TDI detector operates quasi- 
synchronously with the movement of the image. In quasi-synchronous operation, 

15 the pixilated signal is clocked synchronously with the image to extend the signal 
integration time, followed by a period of asynchronous clocking, employed to 
separate the image from the pixilated signal on the detector. 

In the simplest case of a TDI detector with no inclination relative to the 
axis of motion, the time T p required for the image and the signal to diverge by one 

20 row of pixels is defined by: 



where the velocity of the image across the detector is Vi, the velocity of the TDI 
detector signal is V s , and the pixel height is P. Note that the two velocities can be in 
opposite directions. In the case of the inclined detector, the velocity of the detector 
25 signal V s is replaced with the projected velocity V s ' of Equation (1) such that : 



The divergence of the signal and image on the TDI detector during 
asynchronous operation enables the second preferred embodiment to gather 
independent images of a single object over time. The time resolution of the 
30 system is governed by Equation (3), as well as being a function of the image 
height. When the image of an object is N pixels high on the TDI detector, the 
time required to prevent the overlap of two successive images is: 



T p =IP/(V s -V0I. 



(2) 



T p = IP/((V s *Cos(cj))) - Vi)!. 



(3) 



T p = (N*P)/((V s *Cos((j>)) - Vi) 



(4) 



In this mode of operating the second preferred embodiment, discontinuous 
35 detection is used to increase image acquisition throughput and to prevent image 
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blurring, despite the difference between signal and image velocities produced by 
asynchronous readout of the TDI detector. Image integrity is preserved by 
limiting the object's detection time to less than T p , the time required for the image 
and the signal to diverge on the TDI detector by one pixel. Preferably, control of 
5 the detection period is achieved by controlling the duration of illumination. In the 
case of objects that continuously emit light, the TDI detector is shuttered and is 
exposed to light from the object for a time less than T p . After a detection period, a 
subsequent detection period is delayed until the image and the signal have 
diverged on the detector by a distance equal to or greater than the image height. 

10 In this manner, multiple unblurred images of an object can be detected in rapid 
succession. In comparison to a frame-mode detector, which must be completely 
read out after each detection period, the second embodiment can produce higher 
image acquisition rates by a factor approximately equal to the ratio of the detector 
height to the image height. 

15 FIGURES 4A-4F include a plurality of time frames corresponding to a 

time-series illustration of the first operating mode of the second preferred 
embodiment. In a first time frame 64, illumination 62 of cell 58 is limited to less 
than the time it takes a first image 76 to travel one pixel on TDI detector 44, 
halting before a second time frame 66. In second time frame 66, a first signal 78 

20 generated by the first image is clocked down TDI detector 44 at a velocity ratio of 
four pixels of signal movement on the TDI detector for each pixel of image 
movement. In a third time frame 68, first signal 78 has diverged from the position 
of cell 58 on TDI detector 44, and illumination 62 is restored briefly to generate a 
second image 80. Illumination is again halted by a fourth frame 70, while first 

25 signal 78 and a second signal 82 produced in response to second image 80 
propagate down the detector until the divergence has again exceeded the image 
height. This process continues, generating numerous image signals at different 
times for a cell that is in view, as shown by a third image 84 and a third signal 86 
in FIGURES 4E and 4F, corresponding to fifth and sixth time frames 72 and 74 . 

30 With reference to FIGURES 5A-5F, a plurality of time frames 88, 90, 92, 

94, 96, and 98 produced in accord with the second operating mode of the second 
embodiment are shown. In this mode, the velocity of cell 58 is higher than the 
clock rate of the signals from TDI detector 44, in contrast to FIGURES 4A-4F, 
wherein the clock rate of the signals is higher than the velocity of the cell. 

35 Images 76, 80, and 84 are incident of the TDI detector, producing corresponding 
signals 78, 82, and 86. Otherwise, operation of the system is comparable to that 
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described above with reference to FIGURES 4A-4F. The third mode of operation 
for the second preferred embodiment is not illustrated. 

The? inclination of the detector in the second preferred embodiment causes 
each discrete image to lie at a different focal plane within the object. The 2D 
5 images measured at different focal planes across the object can then be 
reconstructed into a 3D representation of the object. FIGURES 6A and 6B 
illustrate this aspect of the second preferred embodiment. FIGURE 6A is a view 
of the flow path of a cell nucleus 158 over time, looking in a direction orthogonal 
to the optic axis of the imaging system. Cell nucleus 158 contains two FISH 

10 probes 160 and 162 disposed at different distances from an inclined focal 
plane 164 at different times. FIGURE 6B is a view of TDI detector 148 looking 
along the optic axis of the imaging system. FIGURE 6B shows images 166 and 
168 of FISH probes 160 and 162, respectively, taken at various positions of cell 
nucleus 158 relative to inclined focal plane 164, which is shown in FIGURE 6 A. 

15 Images 166 and 168 exemplify the image spreading incurred when a feature of 
interest, such as FISH probes 160 and 162, is out of focus when imaged on the 
detector. Since cell nucleus 158 is a 3D object, FISH probes 160 and 162, which 
are contained with the cell nucleus, are unlikely to be in focus simultaneously. 
The use of the inclined TDI detector enables images to be gathered at different 

20 focal planes within cell nucleus 158, so that the 3D spatial relationship between 
the FISH probes can be resolved. 

From the above discussion, it will be clear to those skilled in the art that 
the concept of inclining a TDI detector to detect signals at different planes of 
focus can be applied to any of the disclosed preferred embodiments of the present 

25 invention that were included in the above-referenced patent applications, and is 
not limited to the embodiments discussed hereinabove. Accordingly, the 
invention is broadly applicable to many applications in which a TDI detector is 
used for imaging objects. 

Although the present invention has been described in connection with the 

30 preferred form of practicing it, those of ordinary skill in the art will understand 
that many modifications can be made thereto within the scope of the claims that 
follow. Accordingly, it is not intended that the scope of the invention in any way 
be limited by the above description, but instead be determined entirely by 
reference to the claims that follow. 
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The invention in which an exclusive right is claimed is defined by the 
following: 

1. A system for obtaining at least one output signal corresponding to 
at least one image of an object that is formed along an inclined focal plane passing 
through the object, wherein there is relative motion between the object and the 
system, comprising: 

(a) a time delay integration (TDI) detector disposed to receive 
light from the object along an imaging path, forming said at least one image of the 
object on a plane of said TDI detector that is inclined at an angle relative to the 
imaging path, so that the plane of the TDI detector is not perpendicular to the 
imaging path, said angle determining an angle of the inclined focal plane; and 

(b) an optical element disposed between the object and the TDI 
detector and oriented so that light traveling from the object is directed along the 
imaging path to form said at least one image of the object on the plane of the TDI 
detector, in response thereto, said TDI detector producing one of: 

(i) an output signal corresponding to an image of the 
object relative to the inclined focal plane, said output signal being a composite of 
the light from the object at differing focal positions within the object, taken along 
the inclined focal plane, and being indicative of at least one characteristic of the 
object at the differing focal positions; and 

(ii) a plurality of output signals, each output signal 
corresponding to an image of the object formed on the plane of the TDI detector 
relative to a different focal position along the inclined focal plane, said plurality of 
output signals being indicative of at least one characteristic of the object at 
different focal positions within the object, along the inclined focal plane. 

2. The system of Claim 1, wherein the TDI detector comprises one of 
a charge-coupled device, a complementary metal oxide semiconductor, and a 
multi-channel plate imaging device. 

3. The system of Claim 1, wherein the TDI detector comprises a 
plurality of light-sensitive pixels that produce a pixilated output signal. 

4. The system of Claim 3, wherein the plurality of light-sensitive 
pixels are generally arranged in a quadrilateral array in the plane of said TDI 
detector. 
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5. The system of Claim 4, wherein the output signal is read from one 
of a row and a column of the quadrilateral array. 

6. The system of Claim 1, wherein the output signal propagates over 
the TDI detector with a velocity and in a direction determined by the relative 
motion between the object and the system. 

7. The system of Claim 1, wherein the output signal propagates over 
the TDI detector with a velocity that is substantially synchronous with that of a 
corresponding image of the object formed on the TDI detector. 

8. The system of Claim 1, wherein the output signal propagates over 
the TDI detector with a velocity that is substantially asynchronous with that of a 
corresponding image of the object formed on the TDI detector. 

9. The system of Claim 8, wherein each image of the object is formed 
on the TDI detector in a time sufficiently short so that the image and the output 
signal produced in response thereto diverge by less than a pixel of the TDI 
detector. 

10. The system of Claim 1, wherein the plurality of output signals are 
spaced apart sufficiently over the plane of the TDI detector so that the plurality of 
output signals do not overlap. 

11. The system of Claim 1, wherein a velocity of the output signal 
propagating over the plane of the TDI detector is synchronous with a velocity of a 
corresponding image formed on the TDI detector for a portion of the time during 
which the output signal propagates and asynchronous with the velocity of the 
corresponding image for another portion of the time. 

12. The system of Claim 1, further comprising a pulsating light source 
that periodically illuminates the object. 

13. The system of Claim 1, wherein the object is entrained in a flowing 

fluid. 

14. The system of Claim 1, wherein one of the object and the system is 
stationary. 
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15. The system of Claim 1, wherein both the system and the object are 
in motion. 

16. The system of Claim 1, further comprising one of a shutter and a 
gate disposed in the image path, said one of the shutter and the gate periodically 
enabling light from the object to reach the TDI detector. 

17. The system of Claim 16, wherein said one of the shutter and the 
gate is disposed between the TDI detector and the object. 

18. The system of Claim 1, further comprising a dispersing element 
disposed in the image path for dispersing the light into spectral components, said 
spectral components being indicative of said at least one characteristic of the 
object. 

19. A method for determining at least one characteristic of an object, 
comprising the steps of: 

(a) directing light from the object onto a generally planar 
surface of a time delay integration (TDI) detector to form an image of the object, 
said generally planar surface being inclined relative to an axis along which the 
light from the object is directed onto the TDI detector, said TDI detector 
producing an output signal corresponding to the image of the object at least at one 
point along an inclined focal plane that passes through the object, said inclined 
focal plane being inclined relative to the planar surface of the TDI detector so that 
the inclined focal plane intersects the object at different focal points within the 
object over time; and 

(b) reading the output signal from the TDI detector, said output 
signal being indicative of said at least one characteristic of the object at said at 
least one focal point within the object. 

20. The method of Claim 19, wherein the step of directing the light 
comprises the step of focusing the light with an optical element disposed between 
the object and the TDI detector. 

21. The method of Claim 19, wherein the step of directing the light 
comprises the step of dispersing the light from the object into spectral components 
to form a spectral image of the object on the generally planar surface of the TDI 
detector. 
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22. The method of Claim 19, further comprising the step of 
propagating the output signal over the TDI detector at a defined velocity. 

23. The method of Claim 22, wherein there is relative motion between 
the object and the TDI detector. 

24. The method of Claim 23, wherein the output signal is propagated 
over the TDI detector along a path that is generally aligned with a direction of the 
relative motion between the object and the TDI detector. 

25. The method of Claim 23, wherein the defined velocity of the 
output signal over the TDI detector is substantially equal to a velocity of the 
image of the object formed on the TDI detector. 

26. The method of Claim 23, further comprising the step of 
periodically exposing the TDI detector to the light from the object. 

27. The method of Claim 26, wherein the output signal is propagated 
over the TDI detector at a velocity sufficient to prevent a successive image of the 
object from overlapping the output signal. 

28. The method of Claim 19, wherein the step of reading the output 
signal comprises the step of reading a voltage from one of a row and a column of 
the TDI detector. 

29. The method of Claim 19, wherein said at least one characteristic of 
the object comprises the step of detecting one of: 

(a) a presence of a fluorescence in-situ hybridization (FISH) 
probe disposed on the object; 

(b) a presence of a plurality of FISH probes within the object; 

and 

(c) a location of at least one FISH probe within the object. 

30. The method of Claim 19, further comprising the step of 
determining an intensity of the output signal over time. 

31. The method of Claim 19, further comprising the step of forming a 
composite output signal as the image of the object varies at the different focal 
points along the inclined focal plane. 
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32. The method of Claim 19, further comprising the step of producing 
a plurality of different output signals, each output signal corresponding to a 
different image of the object at a different focal point along the inclined focal 
plane, said plurality of different output signals being sufficiently spaced apart over 
the TDI detector to avoid overlapping each other. 

33. A system for obtaining an output signal corresponding to an image 
of an object and indicative of at least one characteristic of the object, wherein 
there is relative motion between the object and the system, comprising: 

(a) a time delay integration (TDI) detector disposed to receive 
light from the object along an imaging path, a plane of said TDI detector being 
inclined at a non-orthogonal angle relative to the imaging path and inclined 
relative to a direction of the relative motion, said TDI detector producing an 
output signal that propagates over the TDI detector and corresponds to the image 
of the object formed on the TDI detector at least at one focal point along an 
inclined focal plane that passes through the object; and 

(b) an optical element disposed between the object and the TDI 
detector and oriented so that light traveling from the object is directed along the 
imaging path onto the plane of the TDI detector, forming the image of the object 
on the TDI detector, said output signal from the TDI detector being indicative of 
said at least one characteristic of the object at said at least one focal point within 
the object. 

34. The system of Claim 33, wherein image of the object and the 
output signal propagate over the TDI detector at substantially the same velocity. 

35. The system of Claim 34, wherein the output signal comprises a 
composite output signal corresponding to the image of the object formed on the 
TDI detector at a varying focal distance defined by the inclined focal plane that 
passes through the object. 

36. The system of Claim 33, wherein the TDI detector produces a 
plurality of output signals corresponding to a plurality of images of the object 
formed on the TDI detector, at a plurality of focal points along the inclined focal 
plane that passes through the object. 
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37. The system of Claim 36, wherein the plurality of output signals 
corresponding to a plurality of images of the object are propagated over the TDI 
detector with a velocity selected such that none of the plurality of output signals 
overlaps. 

38. The system of Claim 36, wherein the plurality of output signals 
corresponding to a plurality of images of the object define a three-dimensional 
representation of the object. 

39. The system of Claim 33, wherein the TDI detector comprises one 
of a charge-coupled device, a complementary metal oxide semiconductor, and a 
multi-channel plate imaging device. 

40. The system of Claim 33, wherein the TDI detector comprises a 
plurality of light-sensitive pixels that produce a pixilated output signal. 

41. The system of Claim 39, wherein the plurality of light-sensitive 
pixels are generally arranged in a quadrilateral array in the plane of said TDI 
detector. 

42. The system of Claim 44, wherein the output signal is read from one 
of a row and a column of the quadrilateral array. 

43. The system of Claim 33, wherein the object is entrained in a 
flowing fluid. 

44. The system of Claim 33, further comprising one of a shutter and a 
gate disposed in the image path, to periodically enable light from the object to 
reach the TDI detector. 

45. The system of Claim 44, wherein the one of the shutter and the 
gated image intensifier alternates between blocking the TDI detector from the 
light and exposing the TDI detector to the light. 

46. The system of Claim 33, further comprising a dispersing element 
disposed in the image path for dispersing the light into spectral components. 
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FIG. 2 
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